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MEMORY SYSTEM INCLUDING A MEMORY MODULE HAVING A 



MEMORY MODULE CONTROLLER 

RELATED APPLICATIONS 

This application is related to and claims the benefit of the filing dates of 
5 the following United States Provisional Patent Applications: (1) Provisional 

Application No. , entitled DISTRIBUTED CONTROL MEMORY 

BUS ARCHITECTURE, filed on December 5, 1997; and (2) Provisional 

Application No. , entitled DISTRIBUTED CONTROL MEMORY 

BUS ARCHITECTURE, filed on December 5, 1997. These applications are 
10 assigned to the same assignee as the present application. 

This application is also related to U.S. Patent Application No. , 

entitled MEMORY MODULE INCLUDING A MEMORY MODULE 
CONTROLLER filed on February 13, 1998, and U.S. Patent Application No. 

, entitled MEMORY MODULE CONTROLLER filed on February 13, 

15 1998, each of which is assigned to the assignee of the present application. 
FIELD OF THE INVENTION 

The present invention pertains to the field of memory systems. More 
particularly, the present invention relates to a memory system that includes a 
memory controller on a memory module. 
20 BACKGROUND 

Memory modules such as single in-line memory modules (SIMMs) 
and dual in-line memory modules (DIMMs) are typically used to store data, 
instructions, and other information in computers or other digital systems. 
Figure 1 shows a typical memory system in which processor 102 
25 communicates with dynamic random access memory (DRAM) devices 110- 
117 on memory modules 106 and 108, respectively, via memory controller 
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104. Memory controller 104 communicates appropriate memory instructions 
(e.g., write, read, refresh, etc.) to memory module 106 via address and 
command bus 118, and to memory module 108 via address and command bus 
120. Data is transferred from memory controller 104 to both modules via bus 
5 122. 

There are at least two disadvantages associated with the conventional 
memory system of Figure 1: (1) buses 118, 120, and 122 are multi-drop buses 
that have high capacitive loads which require large drivers in memory 
controller 104 and in DRAMs 110-117 (to drive bus 122); and (2) there tends to 

10 be large mismatches in loading between the address and command buses and 
data bus 122. These disadvantages combine to reduce the maximum 
operating frequency, increase power consumption, and decrease performance 
of the system. Additionally, memory controller 104 may include a high 
number of pins (e.g., approximately 190 pins for a 4 DIMM SDRAM system) to 

15 support access to memory modules 106 and 108. The bus width of data bus 
122 is often 64 or 72 bits wide to support larger bandwidths, for example, of up 
to 100 mega transmissions per second (MT/s). 

Figure 2 shows another typical memory system that uses technology 
from Rambus, Inc. of Mountain View, California. In this system, processor 

20 202 communicates with Rambus dynamic random access memory 

(RDRAM™) devices 210-217 on memory modules 206 and 208 (also called 
Rambus in-line memory modules or RIMM™ modules), respectively, via 
memory controller 204. Memory controller 204 communicates appropriate 
memory instructions (e.g., write, read, refresh, etc.) and data in a time- 

25 multiplexed fashion to memory modules 206 and 208 via memory specific 
bus 226. Each of the RDRAM™ devices 210-217 include interface logic 218- 
225, respectively, that enables the RDRAM™ devices to interface to memory 
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specific bus 226* Memory specific bus 226 may operate at a high frequency 
(e.g., 250 to 400 MHz), have a small bus width (e.g., 16 or 18 signal lines), have 
symmetric loading for address, command, and data information, and have a 
bandwidth of up to 800 MT/ s. In other embodiments, the address and control 
5 information may be separated (demultiplexed) from the data bus in this 
environment. 

The system of Figure 2 has a number of disadvantages. Each 
RDRAM™ device includes a significant amount of logic in the interface logic 
which makes implementation of the RDRAM™ devices more difficult and 

10 more expensive than other DRAM devices, and which causes the RDRAM™ 
devices to draw more power and dissipate more heat than if the logic was not 
present. This may lead to thermal and reliability problems. Additionally, 
each RDRAM™ typically includes a delay locked loop (DLL) circuit coupled to 
a plurality of clock signals on bus 226. The DLL circuits are typically always 

15 functioning and drawing significant amounts of power which contributes to 
thermal and reliability issues. Additionally, memory controller 204 must 
include relatively large drivers to drive bus 226 

In each of the memory systems described in Figures 1 and 2, the 
memory controller must be designed to provide the appropriate memory 

20 transactions to the memory devices in a predetermined format and at 

predetermined times. The memory devices and memory controller must 
then be designed to work together. It would be advantageous to decouple the 
design of the memory devices and the memory controller such that 
independent advances may be made in each technology. It would also be 

25 desirable to decouple the operation of the memory devices from the memory 
controller to decrease power drawn by each memory device and by the entire 
memory system. 
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Other features and advantages of the present invention will be 
apparent from the accompanying drawings and from the detailed description 
that follows. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The features and advantages of the present invention are illustrated by 
way of example and not limitation in the figures of the accompanying 
drawings in which like references indicate similar elements and in which: 
5 Figure 1 is a block diagram of one embodiment of a conventional 

memory system; 

Figure 2 is a block diagram of another embodiment of a conventional 
memory system; 

Figure 3 is a block diagram of one embodiment of a memory system 
10 according to the present invention; 

Figure 4 is a block diagram of another embodiment of a memory 
system according to the present invention; 

Figure 5 is a block diagram of one embodiment of a dynamic random 
access memory (DRAM) module including a DRAM memory module 
15 controller; 

Figure 6 is a block diagram of one embodiment of a static random 
access memory (SRAM) module including an SRAM memory module 
controller; 

Figure 7 is a block diagram of one embodiment of nonvolatile memory 
20 module including a nonvolatile memory module controller; 

Figure 8 is a block diagram of one embodiment of the memory module 
controller of Figure 3 coupled to a time multiplexed system memory bus; 

Figure 9 is a flow chart of one embodiment of the process implemented 
by the memory module controller of Figure 8; 
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Figure 10 is a block diagram of one embodiment of the memory 
module controller of Figure 3 coupled to a demultiplexed system memory 
bus; 

Figure 11 is a flow chart of one embodiment of the process 
5 implemented by the memory module controller of Figure 10; 

Figure 12 is a block diagram of one embodiment of a memory module 
including a memory module controller interfacing SDRAM devices with a 
system memory bus using a Direct Rambus™ protocol; 

Figure 13 is a flow chart of one embodiment of a read transaction 
10 implemented by the memory module controller of Figure 12; 

Figure 14 is an exemplary timing diagram of the read transaction 
implemented by the memory module controller of Figure 12; 

Figure 15 is a flow chart of one embodiment of a write transaction 
implemented by the memory module controller of Figure 12; 
15 Figure 16 is an exemplary timing diagram of the write transaction 

implemented by the memory module controller of Figure 12; 

Figure 17 is an exemplary timing diagram of a read transaction 
implemented by the memory module controller of Figure 12 using a 
modified protocol; and 
20 Figure 18 is an exemplary timing diagram of a write transaction 

implemented by the memory module controller of Figure 12 using a 
modified protocol. 
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SUMMARY OF THE INVENTION 

One embodiment of the present invention includes a system that has a 
system memory controller and a memory module. The memory module 
includes a memory module controller coupled to the system memory 
controller and a plurality of memory devices coupled to the memory module 
controller. 

Other objects, features, and advantages of the present invention will be 
apparent from the accompanying drawings and from the detailed description 
that follows. 
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DETAILED DESCRIPTION 

A memory system including distributed control of memory devices on 
memory modules is described. The present invention includes a memory 
module controller device on each memory module in the system. The 
5 memory module controller communicates with the system memory 
controller over a system memory bus and with the individual memory 
devices at the module level The system memory bus may be a low pin 
count, high frequency, multiplexed or demultiplexed bus. The memory 
module controller may communicate with the individual memory devices 

10 over wider, lower frequency, demultiplexed signals lines. As the system 
memory controller communicates directly with only the memory module 
controllers, the loading on the system memory bus may be reduced and the 
size of the bus drivers in the system memory controller may also be reduced. 
The memory module controller on each memory module is the 

15 interface between the system memory controller and the individual memory 
devices on the modules. This architecture decouples the individual memory 
devices from the system memory bus and the system memory controller. 
This may allow for the independent development of the memory device 
technology. For example, the memory devices may be developed to be faster, 

20 wider, to operate at different operating supply voltages, or to operate with 
reduced voltage swings than if the memory devices where directly 
communicating with the system memory controller. 

The memory module may have its own memory address lines, control 
lines, and data lines between the memory module controller and the 

25 individual memory devices. The signal lines for these point-to-point or bus 
connections may be significantly shorter than the system interconnection 
buses used in conventional memory systems. This may allow for reduced 
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loading, better control of capacitance on the address and data lines, and may 
increase the maximum operating frequency of the module while reducing 
power drawn by the system. Additionally, power may be further reduced by 
omitting DLLs from the individual memory devices. A DLL may be included 
5 within the memory module controller if required for interfacing with the 
system memory bus* 

Figure 3 is a block diagram of one embodiment of the present 
invention. System 300 includes processor 302, system memory controller 304, 
and memory modules 306 and 308. Processor 302 communicates with system 

10 memory controller 304. Processor 302 may be any control logic or 
microprocessor that communicates write, read, and other memory 
transactions to system memory controller 304. System memory controller 304 
communicates the memory transactions to memory module controllers 310 
and 316 of memory modules 306 and 308, respectively, via system memory 

15 bus 323. System memory controller 304 may be part of a chip set for a 
personal computer, for example, or it may be other independent logic. 

Memory modules 306 and 308 may be SIMMs, DIMMs, RIMM™ 
modules, or any other type of memory modules. Each memory module 
includes a memory module controller and one or more memory devices. For 

20 example, memory module 306 includes memory module controller 310 and 
memory devices 312-315, and memory module 308 includes memory module 
controller 316 and memory devices 317-320. The memory module controllers 
may be separate integrated circuits from the memory devices. While system 
300 is illustrated as including two memory modules, any number of memory 

25 modules may be used. The memory devices may be placed on one side of the 
module, on both sides of the module, and/or they may be stacked on top of 
each other. The module may also be a multi-chip module. For one 
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embodiment, a memory module may have an approximate height 350 of 
from 1 to 2 inches, and an approximate length 352 of from 4 to 6 inches. 

Memory modules 310 and 316 communicate memory transactions with 
system memory controller 304 via system memory bus 323. System memory 

5 bus 323 may be a low pin count (e.g., approximately 16 to 35 address, data and 
control signal lines) bus operating at a high frequency. For one embodiment, 
system memory bus 323 may operate at a frequency of approximately 200 to 
500 MHz. Other frequencies may be used. System memory bus 323 includes a 
command /address bus 324 and a data bus 328. Command/ address bus 324 

10 may time-multiplex commands and address information on one or more of 
the signal lines. The command and address bus 324 may also be split into 
separate command and address buses as in SDRAMs. System memory bus 
323 may optionally include clock bus 322 that may carry one or more clock 
signals on the same or separate signal lines, and handshaking bus 326 that 

15 may carry a handshaking signal between system memory controller 304 and 
memory module controllers 310 and 316. The handshaking signal may be 
generated by system memory controller 304, for example, at the start of a 
memory request packet or when it is transmitting valid data on data bus 328. 
The handshaking signal may be generated by memory module controllers 310 

20 and 316 when they are providing valid data requested by system memory 
controller 304 to data bus 328. 

For one embodiment, system memory bus 323 may be compatible with 
the Direct Rambus™ bus architecture that includes 16 or 18 data bits on bus 
328, one or more clock signals on bus 322, and command and address 

25 information on bus 324. The clock signals for this embodiment may run at 
rates of approximately 400 MHz enabling a data transmission rate of up to 800 
MT/s. For this embodiment, system memory controller 304 may be any 
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controller that may be able to implement the Direct Rambus™ protocol for 
memory transactions on system memory bus 323. Additionally, system 
memory bus 323 may use Rambus Signaling Levels (RSL) for the signals 
transferred on the bus. For alternative embodiments, any other type of 
5 appropriate signaling levels may be used including TTL, CMOS, GTL, SSTL, 
CTT or other signaling levels. 

For another embodiment, system bus 323 may be one general purpose 
bus that carries time-multiplexed address, data, and control information. For 
example, system bus 323 may be compatible with Concurrent and Base 

10 Rambus™ architectures. For these embodiments, system memory controller 
304 may be any controller that may be able to implement these protocols for 
memory transactions on system memory bus 323. 

System memory bus 323 may by physically placed on a printed circuit 
board (PCB) that includes system memory controller 304 and interconnection 

15 slots for modules 306 and 308 as shown in Figure 3. Alternatively, system 
memory bus 323 may be routed through separate channels of memory 
modules 306 and 308 such as channels 402, 404, 406, and 408 as shown in 
Figure 4. 

Memory module controllers 310 and 316 operate as bridges between 
20 system memory bus 323, that operates in one protocol or format, and local or 
memory module buses (e.g., lines 330, 332, and 334-337) that operate in a 
second different protocol or format. Each memory module includes control 
logic necessary to interpret the memory transaction on system memory bus 
323 and translate that transaction into the appropriate control, address, and 
25 data signals for its memory devices on the memory module. Similarly, the 
memory modules interpret the memory transactions on the local or memory 
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module bus into the format required to transmit the transaction to the system 
memory controller 304 via system memory bus 323. 

Memory module controllers 310 and 316 may also include circuitry 
necessary to perform refresh operations of dynamic memory devices, prefetch 
5 operations, error correction functions that may use, for example, ECC bits, 
current calibration if system memory bus 323 is a current bus, serial presence 
detect circuitry, a DLL circuit, power management circuitry that may shut off 
the clock signals or clock enable signals for the memory devices or provide 
other power down circuits, program and erasing voltages for nonvolatile 

10 memory circuits, and /or levelizing circuitry to generate signals on system 
memory bus 323 in the appropriate clock domains (if there is more than one 
clock domain on system memory bus 323). 

Each memory device on the memory modules communicates memory 
transactions with its memory module controller via address, data, and control 

15 signals. Memory transactions are those transactions that are appropriate for 
each type of memory device used. For example, the memory transactions 
may include write, read, refresh, prefetch, power down, reset, erase, and the 
like. Memory module 306, for example, may communicate memory 
addresses to memory devices 312-315 via signal lines 330, control information 

20 (e.g., chip enable signals, write enable signals, RAS, CAS, output enable 

signals, etc.) via signal lines 332, and data via point-to-point connections 334- 
337. Each of the signal lines 330, 332, and 334-337 may be one or more signal 
lines. Signal lines 330 and 332 may be buses that connect to all four memory 
devices 312-315, to groups of memory devices (e.g., two at a time), or they may 

25 be point-to-point connections to memory module controller 310. Similarly, 
memory module 308 may communicate memory addresses to memory 
devices 317-320 via signal lines 338, control information via signal lines 340, 
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and data via point-to-point connections 341-344. Each of the signal lines 338, 
340, and 341-344 may be one or more signal lines. 

For one embodiment, the number of signal lines 334-337 may be the 
same as the number of signal line carrying data for system memory bus 323. 
5 For another embodiment, the number of signal lines 334-337 may be 

collectively greater than the number of signal lines carrying data from system 
memory controller 304 to memory module controller 310 on system memory 
bus 323. This may increase the bandwidth of the data transfer on the memory 
module. For example, system memory bus 323 may carry 16 data signals in 

10 parallel on bus 328 and memory module controller 310 may simultaneously 
provide 16 data signals to each of memory devices 312-315. Because the data 
bus width may be wider (e.g., 64 or 72 bits wide) than that of system memory 
bus 323 (e.g., 16 bits wide), memory module controller 310 may supply a clock 
signal on bus 330 to memory devices 312-315 that is a lower frequency than 

15 that running on system memory bus 323. For one embodiment, the clock 

frequency on bus 330 may be approximately 50 to 200 MHz, for example, when 
the frequency of the clock signal on clock bus 322 is approximately 100 to 400 
MHz. The frequency of the clock signal on clock bus 322 may also be double- 
pumped, that is, perform an action (e.g., load data) on each clock edge. 

20 By having local address, control, and data lines on the memory 

modules which are decoupled from system bus 323, the length of these signals 
may be reduced over those on the system memory bus, the loading of these 
lines may be reduced over that of the system memory, and the loading may be 
more accurately controlled between the different lines so as to more closely 

25 achieve symmetric loading between the signals lines. For example, the 
loading on the data lines and the address and control lines may have 
approximately the same loading (e.g., approximately 10 to 40 pF) plus or 
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minus approximately 10 percent. This may advantageously decrease the 
amount of power drawn by the module and increase the maximum operating 
frequency of the module for a given memory transaction. 

Additionally, by decoupling the memory devices from system memory 
5 bus 323 and system memory controller 304, memory device 312-315 and 317- 
320 may operate from reduced or different power supply voltages than those 
provided to the balance of system 300. For example, memory devices 312-315 
and 317-320 (and/or memory module controllers 310 and 316) may operate 
from power supplies of approximately 1.8 volts to 2.5 volts while the balance 
10 of the components in system 300 may operate at 3.3 volts or 5.0 volts. This 
may also operate to decrease the amount of power drawn by the module and 
thus by system 300. Additionally, the voltage swing of the signals on lines 
330, 332, and 334-337 may be advantageously chosen to be small (e.g., 
approximately 1.0 to 2.0 volts) to further reduce power drawn by memory 
15 devices 312-315. 

Power may be further reduced for each memory device and for the 
system as a whole when a DLL is required to interface with system memory 
bus 323. The DLL may be included within memory module controller 310 
rather than each of memory devices 312-315 as my have been required in 
20 conventional systems. 

For another embodiment, address lines 330, control lines 332, and /or 
data lines 334-337 may be combined into a time-multiplexed bus coupled 
between memory devices 312-215 and memory module controller 310. 

The memory devices 312-315 and 317-320 may be any type of volatile or 
25 nonvolatile memory devices such as DRAMs, synchronous DRAMs 
(SDRAMs), Fast Page Mode DRAMs (FPM DRAMs), extended data out 
DRAMs (EDO DRAMs), Rambus DRAMs (RDRAM™ devices), synchronous 
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or asynchronous static random access memory (SRAM) devices, read only 
memory (ROM) devices, programmable ROM (PROM) devices, erasable 
PROMs (EPROMs), electrically erasable PROMs (EEPROMs), flash memory 
devices, and the like. Each memory module may include different types of 
5 memory devices. For example, memory module 306 may include SDRAMs 
and memory module 308 may include EDO DRAMs, or memory module 306 
may include nonvolatile memory devices and memory module 308 may 
include volatile memory devices. 

Figure 5 is a block diagram of memory module 500 that is one 

10 embodiment of memory module 306 configured as a DRAM memory 

module. Module 500 includes DRAM memory module controller 510 that 
provides an interface between DRAM devices 512-515 and system memory 
bus 323. DRAM memory module controller 510 translates memory 
transactions received from system memory bus 323 and generates DRAM 

15 memory operations (e.g. write, read, prefetch, refresh) including addresses on 
address bus 516, data signals on data lines 523-526, and control signals such as 
write enable WE on line 518, RAS on line 520, and CAS on line 522. DRAM 
memory module controller 510 may also provide additional control signals to 
DRAMs 512-515 including clock signals for synchronous operation (i.e., for 

20 SDRAMs), memory bank select signals, and /or chip select or chip enable 
signals. DRAM memory module controller may also generate refresh 
commands, prefetch commands, and /or power management commands to 
DRAMs 512-515. 

Figure 6 is a block diagram of memory module 600 that is one 

25 embodiment of memory module 306 configured as an SRAM memory 

module. Module 600 includes SRAM memory module controller 610 that 
provides an interface between SRAM devices 612-615 and system memory bus 
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323. SRAM memory module controller 610 translates memory transactions 
received from system memory bus 323 and generates SRAM memory 
operations (e.g., write, read, reset, power down) including addresses on 
address bus 616, data signals on data lines 623-626, and control signals such as 
5 chip select or chip enable CE on line 618, write enable WE on line 620, and 
output enable on line 622. SRAM memory module controller 610 may also 
provide additional control signals to SRAMs 612-615 including clock signals 
for synchronous operation, burst control signals, interrupt signals, reset 
signals, write and read signals (e.g., for a first-in-first-out FIFO device), power 

10 management signals, byte enable signals, and /or expansion signals. 

Figure 7 is a block diagram of memory module 700 that is one 
embodiment of memory module 307 configured as an nonvolatile memory 
module. Module 700 includes nonvolatile memory module controller 710 
that provides an interface between nonvolatile devices 712-715 and system 

15 memory bus 323. Nonvolatile memory module controller 710 translates 
memory transactions received from system memory bus 323 and generates 
nonvolatile memory operations (e.g., write or program, read, reset, power 
down, erase, etc.) including addresses on address bus 716, data signals on data 
lines 723-726, and control signals such as chip select or chip enable CE on line 

20 718, write enable WE on line 720, output enable on line 722, and a 

programming voltage on line 728. Nonvolatile memory module controller 
710 may also provide additional control signals to nonvolatile memory 
devices 712-715 including clock signals for synchronous operation, burst 
control signals, reset signals, power management signals, or other signals or 

25 commands. 

With reference again to Figure 3, system memory controller 304 and 
memory module controllers 310 and 316 may communicate using any 
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number of protocols as previously mentioned. In general, these protocols 
may be multiplexed such that some or all of the address, control, and data 
information is sent over the same bus lines of system memory bus 323. 
Alternatively, the protocols may be demultiplexed as shown in Figure 3 with 
5 the data transmitted over a separate data bus from address and control 
information. Whether the protocol is multiplexed or demultiplexed, the 
protocol may also be coupled or decoupled. That is, the protocol may be 
coupled if the system memory controller sends its memory transactions to 
system memory bus 323 at a first point in time and expects the requested data 

10 (in the case of a read transaction) or an acknowledgment signal at a second 

point in time (i.e., a timed response). The protocol may be decoupled by using 
a handshaking or valid signal to indicate the start of a memory transaction or 
to indicate when valid data is transmitted to system memory bus 323 by 
system memory controller 304 of memory module controllers 310 or 316. 

15 Figure 8 is a block diagram of memory module controller 800 that is 

one embodiment of memory module controller 310 using a time multiplexed 
protocol. One embodiment of a time multiplexed protocol may be the Base 
and Concurrent Rambus™ protocols. Other protocols may be also be used. It 
will also be appreciated that memory module controller 800 is only one 

20 embodiment of a memory module controller. Other embodiments may also 
be used without departing from the spirit and scope of the present invention. 

Memory module controller 800 interfaces between system memory bus 
823 that includes one or more clock signal lines 824, a transaction bus 826, and 
may optionally include a valid signal 828. The transaction bus 826 is a general 

25 purpose bus that may carry address, data, and control information for a 

memory transaction. Valid signal 828 is one or more handshaking signals 
that may be used for a decoupled protocol to indicate the start of a memory 
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transaction or to indicate when valid data is present on transaction bus 826. 
Valid signal 828 may be monitored and generated by handshake logic 806 
under the control of control logic 802. Valid signal 828 may be omitted for a 
coupled protocol. Memory module controller 800 also interfaces with 
5 memory devices on a memory module (as in Figure 3) by providing a clock 
signal 830, address signals 832, control signals 823, and data signals 836. Clock 
signal 830 may be omitted for asynchronous memory devices. 

Memory module controller 800 includes request handling logic 804 for 
interfacing with transaction bus 826. Request handling logic 804 may include 

10 deserializing logic that may separate the multiplexed control, address, and 
data information provided on transaction bus 826 and provide these signals 
to control logic 802 via lines 838, 840, and 842, respectively. Request handling 
logic 804 may also include serializing logic that may serialize control, address, 
and data information on lines 838, 840, and 842, respectively, into a time- 

15 multiplexed series of signals to be provided to transaction bus 826. 

Control logic 802 is the intelligence of memory module controller 800, 
and generates the appropriate control, address, and data signals for the 
memory module memory devices in response to the signals received from 
request handling logic 804. Each memory module controller device in each 

20 module may have different control logic that may be implement a specific 
translation between the signal types and protocol on the system memory bus 
and the specific memory signals and protocol expected by the memory devices 
on the memory module. For example, control logic 802 may provide the 
appropriate address signals to address interface circuit 818 via lines 844, the 

25 appropriate control signals to control interface circuit 820 via lines 846, and 
the appropriate data signals to data I/O circuitry 822 via lines 848. The 
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interface circuits may include buffers and register elements to drive address 
832, memory control signals 834, and data 836. 

Interface circuits 818, 820, and 822 may be clocked by a clock signal 
generated by clock generator 810. Clock generator 810 may also provide a 
5 clock signal to control logic 802 and to clock buffers 816 which may drive clock 
signal 830 and /or clock enable signals to memory devices on a memory 
module. Clock generator 810 may generate clock signals in response to clock 
824 provided from system memory bus 823. CLK 830 may be a different 
frequency than clock 824. Memory module controller 800 or clock generator 
10 810 may further include a DLL, clock buffer, or clock divider circuit that 
shapes or alters clock 824 before it reaches clock generator 810. 

Memory module controller 800 may also include a power manager 
unit 808 that, under the control of control logic 802, may enable or disable 
clock generator 810. This may, in turn, enable or disable clock 830 or a clock 
15 enable signal provided to the memory devices on a memory module so as to 
control power dissipated by the memory devices. 

Memory module controller 800 may further include refresh logic 814 
and prefetch logic 812. Under the control of control logic 802, refresh logic 814 
may send refresh control signals to memory devices on a memory module 
20 via control interface circuit 820. Control logic 802 may generate the refresh 
command at an appropriate time, or it may generate a refresh command in 
response to a refresh command sent over transaction bus 826 from system 
memory controller 304. Prefetch logic 812 may, under the control of control 
logic 802, prefetch a page of data from memory devices (e.g., DRAM devices) 
25 and store the prefetched data for use in memory read transactions. 

Memory module controller 800 may further include serial presence 
detect circuitry, ECC circuitry, current calibration circuitry, and other circuitry 

- 20 - 42390.P5346 



that may be removed from either the system memory controller or from the 
memory devices to reduce the complexity of the designs of these parts. This 
may reduce the number of pins on the system memory controller. 

Figure 9 shows a flow chart that illustrates one embodiment of the 
5 operation of memory module controller 800 for write and read transactions. 
The process may be a pipelined process or implemented a single stage process. 
It will be appreciated that memory module controller 800 may perform many 
more functions besides translating write and read transactions between a 
system memory controller and memory devices on a memory module. 

10 The process starts at step 902. At step 904, memory module controller 

800 receives a memory transaction request on transaction bus 826. Data 
handling logic 804 deserializes the transaction at step 906 to obtain the 
address, control, and data information of the transaction. At step 908, control 
logic 802 inspects the deserialized information and determines if the 

15 transaction is directed to a memory device of the module controlled by 

memory module controller 800. This may be accomplished by inspecting the 
memory address received to see if it corresponds to an address occupied by 
one of the memory devices in the memory module. If the transaction is not 
directed to a memory device controlled by memory module controller 800, 

20 the process returns to step 902. If the transaction is directed to a memory 
device controlled by memory module controller 800, control logic 802 
determines what type of transaction is requested at step 910. If the transaction 
is a write transaction, control logic 802 generates the appropriate write control 
signals (e.g., WE, CS, etc.) at step 912 and provides these signals to control 

25 interface circuit 820. At step 914, control logic 802 then provides the write data 
in the appropriate data format to data I/O circuitry 822 and the address of the 
selected memory device to address interface circuit 818. The write data may be 
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buffered in a write buffer (not shown). The data may then be written into the 
desired memory location of the selected memory device. At step 916, an 
optional acknowledge signal may be sent back to the system memory 
controller after the write operation is completed. The process then returns to 
5 step 902. 

If the transaction is a read transaction, , control logic 802 then provides 
the read address of the selected memory device to address interface circuit. At 
step 920 control logic 802 generates the appropriate read control signals (e.g., 
WE, CS, OE, etc.) and provides these signals to control interface circuit 820. 

10 The data may then be read from the desired memory location of the selected 
memory device. The read data may be buffered in a read buffer (not shown), 
stored in control logic 802, or registered. At step 922, the read data may be 
provided to request handling logic 804 where it is serialized and may be 
framed by other data including, for example, a request number indicating this 

15 particular read transaction. At step 924, the read data may then be sent back to 
the system memory controller when system memory bus 823 is free or when 
all other previous transactions have been completed. For one embodiment, 
handshake logic 806 or other logic (e.g., request handling logic 804, control 
logic 802, or other bus monitoring logic) may monitor the activity on system 

20 memory bus 823 and indicate to control logic 802 when it is the turn of 

memory module controller 800 to send its read data to the system memory 
controller on bus system memory bus 823. The read data may be sent back 
with valid signal 828 in a decoupled system. The process then returns to step 
902. 

25 Figure 10 is a block diagram of memory module controller 1000 that is 

one embodiment of memory module controller 310 using a demultiplexed 
protocol. One embodiment of a de multiplexed protocol may be Direct 
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Rambus™ protocol Other protocols may be also be used. It will also be 
appreciated that memory module controller 1000 is only one embodiment of 
a memory module controller. Other embodiments may also be used without 
departing from the spirit and scope of the present invention. 
5 Memory module controller 1000 interfaces between system memory 

bus 1023 that includes one or more clock signal lines 1024, a command and 
address bus CMD/ADDR 1026, data bus 1027, and may optionally include a 
valid signal 1028. CMD/ADDR bus 1026 may carry both address and control 
information for a memory transaction. Alternatively, CMD/ADDR bus 1026 

10 may be separated into separate command and address buses. Valid signal 1028 
is a handshaking signal that may be used for a decoupled protocol to indicate 
the start of a memory transaction or to indicate when valid data is present on 
transaction bus 1026. Valid signal may be monitored and generated by 
handshake logic 1006 under the control of control logic 1002. Valid signal 

15 1028 may be omitted for a coupled protocol Memory module controller 1000 
also interfaces with memory devices on a memory module (as in Figure 3) by 
providing a clock signal 1030, address signals 1032, control signals 1023, and 
data signals 1036. Clock signal 1030 may be omitted for asynchronous 
memory devices. 

20 Memory module controller 1000 includes request handling logic 1004 

for interfacing with transaction bus 1026. Request handling logic 1004 may 
include deserializing logic that may separate the multiplexed control and 
address information provided on CMD/ADDR bus 1026 and provide these 
signals to control logic 1002 via lines 1042 and 1044, respectively. Request 

25 handling logic 1004 may also include serializing logic that may serialize 

control and address information on lines 1042 and 144, respectively, into a 
series of signals to be provided to CMD/ADDR bus 1026. 
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Memory module controller 1000 further includes data handling logic 
1046 that may receive data from data bus 1027, reformat the data into a format 
appropriate for the memory devices of the memory module and provide the 
reformatted data to write buffer 1012. For one embodiment, data handling 
5 logic 1046 may include deserializing or unpacking logic to perform the 
translation between, for example, a narrow (e.g., 16 bit) data bus 1027 and a 
wider (e.g., 64 bit) memory device data bus 1036. The data may be stored in 
write buffer 1012 until it needs to be provided to a memory device via data 
1/ O circuitry 1022. A corresponding address for the write data may be stored 

10 in address storage unit 1014. For an alternative embodiment, write buffer 

1012 may be omitted. Data handling logic 1046 may also receive data from the 
memory devices of a memory module via data I/O circuitry 1022 and/or read 
buffer 1038. Data handling logic may then reformat the data into a format 
expected by the protocol of system memory bus 1023. For one embodiment, 

15 data handling logic 1046 may include serializing or packing logic to perform 
the translation between, for example, a wider (e.g., 64 bit) ) memory device 
data bus 1036 and a narrower (e.g., 16 bit) data bus 1027. For yet another 
embodiment, data handling logic may be omitted and the formatting of data 
may be performed by control logic 1002. 

20 Control logic 1002 is the intelligence of memory module controller 

1000, and provides the appropriate control, address, and data signals for the 
memory module memory devices in response to the signals received from 
request handling logic 1004. Each memory module controller device in each 
mode may have different control logic that may be implement a specific 

25 translation between the signal types and protocol on the system memory bus 
and the specific memory signals and protocol expected by the memory devices 
on the memory module. For example, control logic 1002 may provide the 
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appropriate address signals to address interface circuit 1018 via lines 1048, the 
appropriate control signals to control interface circuit 1020 via lines 1050, and 
the appropriate data signals to data I/O circuitry 1022 by controlling write 
buffer 1012 via line 1052 and address storage 1014 via lines 1054. Control logic 
5 1002 may also provide the appropriate control signal to read buffer 1038 to 
control when data read from a memory device on a memory module is 
provided to data handling logic 1046. The interface circuits may include 
buffers and register elements to drive address 1032, memory control signals 
1034 and data 1036. 

10 Interface circuits 1018, 1020, and 1022 may be clocked by a clock signal 

generated by clock generator 1010. Clock generator 1010 may also provide a 
clock signal to control logic 1002 and to clock buffers 1016 which may drive 
clock signal 1030 and/or clock enable signals to memory devices on a memory 
module. Clock generator 1010 may generate clock signals in response to a 

15 clock signal provided by DLL 1058. DLL 1058 may receive on or more clock 
signals 1024 provided from system memory bus 1023. CLK 1030 may be a 
different frequency than clock 1024. 

Memory module controller 1000 may also include a power manager 
unit 1008 that, under the control of control logic 1002 may enable or disable 

20 the clock generator. This may, in turn, enable or disable clock 1030 or a clock 
enable signal provided to the memory devices on a memory module so as to 
control power dissipated by these memory devices. 

Memory module controller 1000 may optionally include address 
storage unit 1040 coupled to control logic 1002, address interface circuit 1018, 

25 and optionally to clock generator 1010. Address storage 1040 may be used to 
store address information that may be provided from CMD/ADDR 1026. 
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Memory module controller 1000 may further include refresh and 
prefetch logic as illustrated in Figure 8 which operates under the control of 
control logic 1002. Memory module controller 1000 may further include 
serial presence detect circuitry, ECC circuitry, current calibration circuitry, and 

5 other circuitry that may be removed from either the system memory 
controller or from the memory devices to reduce the complexity of the 
designs of these parts. This may reduce the number of pins on the system 
memory controller. 

Figure 11 shows a flow chart that illustrates one embodiment of the 

10 operation of memory module controller 1000 for write and read transactions. 
The process may be a pipelined process or implemented a single stage process. 
It will be appreciated that memory module controller 1000 may perform 
many more functions besides translating write and read transaction between a 
system memory controller and memory devices on a memory module. 

15 The process starts at step 1102. At step 1104, memory module controller 

1000 receives a memory transaction request on CMD/ADDR bus 1026. At step 
1006, data handling logic 1004 unpacks or deserializes the command and 
address information and transmits this information to control logic 1002. At 
step 1106, control logic 1002 inspects the unpacked or deserialized information 

20 and determines if the transaction is directed to a memory device in the 
module controlled by memory module controller 1000. This may be 
accomplished by inspecting the memory address received to see if it 
corresponds to an address occupied by one of the memory devices in the 
memory module. If the transaction is not directed to a memory device 

25 controlled by memory module controller 1000, the process returns to step 

1102. If the transaction is directed to a memory device controlled by memory 
module controller 1000, control logic 1002 determines what type of 
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transaction is requested at step 1110. If the transaction is a write transaction, 
control logic 1002 generates the appropriate write control signals (e.g., WE, CS, 
etc.) at step 1112 and provides these signals to control interface circuit 1020. 
Request handling logic 1004 may also provide the write address to address 
5 storage 1014. Alternatively, control logic 1002 may provide the write address 
to address interface circuit 1018, for example, when write buffer 1012 is not 
used. At step 1114, data handling logic 1046 accepts write data from 1027, 
unpacks or deserializes the write data, and provide the write data to write 
buffer 1012, At step 1116, the write data is provided in the appropriate data 
10 format to data I/O circuitry 1022. The data may then be written into the 
desired memory location of the selected memory device. At step .1118, an 
optional acknowledge signal may be sent back to the system memory 
controller after the write operation is completed. The process then returns to 
step 1102. 

15 If the transaction is a read transaction, control logic 1002 generates the 

appropriate read control signals (e.g., WE, CS, OE, etc.) at step 1120 and 
provides these signals to control interface circuit 1020. At step 1122, control 
logic 1002 then provides the read address of the selected memory device to 
address interface circuit 1018. The data may then be read from the desired 

20 memory location of the selected memory device. The read data may be 

buffered in read buffer 1038, stored in control logic 1002, or registered. At step 
1124, the read data may be provided to data handling logic 1046 where it is 
serialized or packed and may be framed by other data including, for example, 
a request number indicating this particular read transaction. At step 1126, the 

25 read data may then be sent back to the system memory when the system 
memory bus is free or when all other previous transactions have been 
completed. For one embodiment, handshake logic 1006 or other logic (e.g., 
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request handling logic 1004, data handling logic 1046, control logic 1002, or 
other bus monitoring logic) may monitor the activity on system memory bus 
1023 and indicate to control logic 1002 when it is the turn of memory module 
controller 1000 to send its read data to the system memory controller on bus 
5 system memory bus 1023. Valid read data may be sent back with valid signal 
1028 in a decoupled system. The process then returns to step 1102. 

Figure 12 is a block diagram of memory module 1200 that is one 
embodiment of memory module 306 of Figure 3. Memory module 1200 is an 
SDRAM module that includes SDRAM devices 1204-1207 and memory 

10 module controller 1202. Memory module controller 1202 provides a bridge 
between system memory bus 1242 using a Direct Rambus™ protocol (and 
coupled to a system memory controller) and SDRAM devices 1204-1207. The 
Direct Rambus™ protocol includes clock signals CLK 1228, /CLK 1230 (where 
the symbol "/" indicates a complementary signal), data Lines 1232, row address 

15 lines 1234, and column address lines 1236. The data may include 16 signals 
lines, the row address may include 3 signal lines, and the column address 
may include 5 signal lines as described in the Advance Information Direct 
RDRAM™ 64/72-Mbit (256Kxl6/18xl6d) data sheet. For one embodiment, 
CLK 1228 and /CLK 1230 may have a frequency of approximately 400 MHz. 

20 Other signals used by this protocol are not shown so as not to obscure the 
present invention. 

Memory module controller 1202 provides memory transactions 
received from system memory bus 1242 to SDRAMs 1204-1207. For one 
embodiment, SDRAMs 1204-1207 may be 64Mb SDRAMs such as described in 

25 the preliminary data sheet of IBM's IBM0364804C, IBM 0364164C, 

IBM0364404C, and IBM03644B4C products published in November 1997. 
Other SDRAMs may also be used. 
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Memory module controller 1202 provides first control information to 
SDRAMs 1204 and 1205 over control bus 1238, and second control 
information to SDRAMs 1206 and 1207 over control bus 1240. Control bus 
1238 may include a clock signal CLK 1208, a clock enable signal CKE 1209, a 
5 write enable signal WE 1210, a column address strobe signal CAS 1211, a row 
address strobe RAS 1212, and one or chip select signals CS 1213. Similarly, 
control bus 1240 may include a clock signal CLK 1216, a clock enable signal 
CKE 1217, a write enable signal WE 1218, a column address strobe signal CAS 
1219, a row address strobe RAS 1220, and one or chip select signals CS 1221. 

10 For one embodiment, the frequency of the CLK 1208 and CLK 1216 may be 
approximately 100 MHz to 200 MHz. Other frequencies may be used. 
Memory module controller also communicates memory address signals 
SDRAMs 1204 and 1205 via address bus 1214, and to SDRAMs 1206 and 1207 
via address bus 1222. For one embodiment, each address bus may include 12 

15 address lines and an additional two bank select lines for selecting banks of 
memory in each SDRAM device. In an alternative embodiment, control bus 
1238 and 1240 may be the same bus as shown in Figure 3. Similarly, address 
buses 1214 and 1222 may be the same bus. Memory module controller also 
communicates read and write data with SDRAMs 1204, 1205, 1206, and 1207 

20 via signal lines 1224, 1225, 1226, and 1227, respectively. For one embodiment, 
each group of signal lines may include 16 data lines. 

Figure 13 shows one embodiment of a process implemented by 
memory module controller 1202 to perform a read transaction from one or 
more of SDRAMs 1204-1207 after receiving a read request from system 

25 memory bus 1242. Figure 13 is described with the aid of the exemplary timing 
diagram of Figure 14. It will be appreciated that Figure 14 shows CLK 1228 
having approximately twice the frequency of CLK 1208. For one embodiment, 
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CLK 1228 may have a frequency of approximately 400 MHz and CLK 1208 may 
have a frequency of approximately 200 MHz. For other embodiments, 
different ratios of frequencies, and /or different frequencies, may be used. 

Memory module controller 1202 may implement the process of Figure 
5 13 using the circuitry shown in memory module 1000 of Figure 10. For 

example, CLK 1024 corresponds to CLK 1228, CMD/ADDR 1026 corresponds to 
row 1234 and column 1236, data 1027 corresponds to data 1232, CLK 1030 
corresponds to CLK 1208, address 1032 corresponds to address 1214, memory 
control signals 1034 corresponds to control bus 1238, and data 1036 

10 corresponds to data 1224. For other embodiments, other circuitry may be used 
to implement the process of Figure 13. 

The process starts at step 1302. At step 1304 and from time tO to time tl, 
an activate command is sent on row lines 1234 including a device, bank, and 
row address of selected memory locations in one or more of SDRAMs 1204- 

15 1207. At step 1306 and from time t2 to time t3, data request logic 1004 
deserializes the command and address information and provides this 
information to control logic 1002. Control logic 1002 then provides the row 
address to the selected SDRAMs over address bus 1214 and/or 1222, and the 
appropriate bank activate command to the selected SDRAMs over control bus 

20 1238 and/or 1240. For one embodiment, the appropriate bank activate 

command includes disabling CAS lines 1211 and /or 1219 and WE lines 1210 
and/or 1218, and enabling CS lines 1213 and/or 1221 and RAS lines 1212 
and/or 1220 at the rising edge of CLK 1208 and/or 1216. 

Because the memory addressing scheme protocol used by Direct 

25 RDRAM™ devices may be different than that used by the selected SDRAMs, 
the activate command supplied on row address lines 1234 may include 
column address information for the selected SDRAMs. In this example, this 
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column address information may be stored in address storage unit 1040 until 
such time that the column address information is issued to the selected 
SDRAMs. 

At step 1308 and from time t4 to time t6, a read command is sent on 
5 column lines 1236. The read command includes device, bank, and column 
address information for the desired read location in the selected SDRAMs. At 
step 1310 and from time t6 to time t7, request handling logic 1004 deserializes 
the read command and provides this information to control logic 1002. 
Control logic 1002 then provides the column address and the read command 

10 to the selected SDRAMs over address bus 1214 and/ or 1222 and over control 
bus 1238 and/or 1240, respectively. For one embodiment, the appropriate read 
command includes disabling RAS lines 1212 and/or 1220 and WE lines 1210 
and/or 1218, and enabling CS lines 1213 and/or 1221 and CAS lines 1211 
and/or 1219 at the rising edge of CLK 1208 and/or CLK 1216. 

15 If there is a difference between the number of bytes selected in the 

selected SDRAMs and the number of bytes expected from a single read 
transaction by the system memory controller, then steps 1308 and 1310 may be 
repeated a desired number of times to match the number of bytes. For 
example, as shown in Figure 14, if the first read command READ1 on column 

20 1236 (together with the activate command on row 1234) addresses 16 bytes of 
data and the read command to the selected SDRAMs addresses 32 bytes of 
data, then a second read command READ2 may be issued from time t6 to time 
t9 to address the second 16 bytes. 

At step 1312 and from time t8 to time tl5, data I/O circuitry 1022 may 

25 receive data read from the selected SDRAMs. For example, 32 bytes of data 
may be read from the four SDRAMs 1204-1207 in the following manner: 
from time t8 to time tlO data I/O circuitry 1022 may receive data packet DO 
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that includes the first eight bytes, two bytes from each of the four SDRAMs 
1204-1207; from time tlO to time tl2 data packet Dl that includes the second 
eight bytes, two bytes from each of the four SDRAMs; from time tl2 to time 
tl3 data packet D2 that includes the third eight bytes, two bytes from each of 
the four SDRAMs; and, from time tl3 to time tl4 data packet D3 that includes 
the last eight bytes, two bytes from each of the four SDRAMs. It will be 
appreciated that for other embodiments a different number of bytes and a 
different number of cycles may be required to read the selected data from the 
selected SDRAMs. 

When the read data is received, it may be stored in read buffer 1038 
prior to providing the data to data handling logic 1046. Alternatively, it may 
be provided directly to data handling logic 1046. At step 1314, data handling 
logic may serialize or pack the data into the proper format expected by the 
system memory controller on data bus 1232. For one embodiment, data 
packets DO and Dl, including a total of 16 bytes of data from SDRAMs 1204- 
1207, may be packed into one uninterrupted transmission DATA1 that may 
provided to data bus 1232 at step 1316 and from time til to time tl5. 
Similarly, data packets D2 and D3, including a second 16 bytes of data from 
SDRAMs 1204-1207 may be packed into one uninterrupted transmission 
DATA2 that may provided to data bus 1232 at step 1316 and from time tl4 to 
time tl6. 

Figure 15 shows one embodiment of a process implemented by 
memory module controller 1202 to perform a write transaction to one or 
more of SDRAMs 1204-1207 after receiving a write request from system 
memory bus 1242. The same process may be used to write data to any of the 
SDRAMs. Figure 15 is described with the aid of the exemplary timing 
diagram of Figure 16. Memory module controller 1202 may implement the 
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process of Figure 13 using the circuitry shown in memory module 1000 of 
Figure 10. 

It will be appreciated that Figure 15 shows CLK 1228 having 
approximately twice the frequency of CLK 1208. For one embodiment, CLK 
1228 may have a frequency of approximately 400 MHz and CLK 1208 may 
have a frequency of approximately 200 MHz. For other embodiments, 
different ratios of frequencies, and/or different frequencies, may be used. 

The process starts at step 1502. At step 1504 and from time tO to time tl, 
an activate command is sent on row lines 1234 including a device, bank, and 
row address of memory locations in one or more of selected SDRAMs 1204- 
1207. At step 1506, data request logic 1004 deserializes the command and 
address information and provides this information to control logic 1002. 

Because the memory addressing scheme protocol used by Direct 
RDRAM™ devices may be different than that used by SDRAMs 1204-1207, the 
activate command supplied on row address lines 1234 may include column 
address information for the selected SDRAMs. In this example, this column 
address information may be stored in address storage unit 1040 until such 
time that the column address information is issued to the selected SDRAMs. 

At step 1508 and from time t2 to time t3, a write command is sent on 
column lines 1236. The write command includes device, bank, and column 
address information for the desired write locations in the selected SDRAMs. 
At step 1510, request handling logic 1004 deserializes the write command and 
provides this information to control logic 1002. If there is a difference 
between the number of bytes selected for writing in the selected SDRAMs and 
the number of bytes selected by the system memory controller, then steps 1508 
and 1510 may be repeated a desired number of times to match the number of 
bytes. For example, as shown in Figure 16, if the first write command 
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WRITE1 on column 1236 (together with the activate command on row 1234) 
selects 16 bytes of data and the write command to the selected SDRAMs 
addresses 32 bytes of data, then a second write command WRITE2 may be 
issued from time t3 to time t4 to address the second 16 bytes. 

At step 1512 and from time t5 to time t6, data handling logic 1046 may 
receive write data DATA1 from data bus 1232 and may unpack or deserialize 
the write data. Data handling logic 1046 may store the write data DATA1 into 
write buffer 1012, and address storage 1014 may store the write address output 
by request handling logic 1004. If a subsequent write or read command is 
received, control logic 1002 may inspect write buffer 1012 and address storage 
1014 for the requested address. If the address is located in address storage 1014, 
then the corresponding data in write buffer 1012 may be read or overwritten. 
If a subsequent write command WRITE2 is issued, then DATA2 received 
from time t8 to time tlO, and associated with this command, may be unpacked 
or deserialized and also stored in write buffer 1012. 

At step 1516 and from time t6 to time t7, control logic 1002 then 
provides the row address to the selected SDRAMs over address bus 1214 
and/ or 1222, and the appropriate bank activate command to the selected 
SDRAMs over control bus 1238 and/or 1240. For one embodiment, the 
appropriate bank activate command includes disabling CAS lines 1211 and /or 
1219 and WE lines 1210 and/or 1218, and enabling CS lines 1213 and/or 1221 
and RAS lines 1212 and/or 1220 at the rising edge of CLK 1208 and/or CLK 
1216. At step 1518 and from time t9 to time til, control logic 1002 then 
provides the column address and the write command to the selected 
SDRAMs over address bus 1214 and/or 1222 and control bus 1238 and/or 1240, 
respectively. For one embodiment, the appropriate write command includes 
disabling RAS lines 1212 and/or 1210 and enabling CS lines 1213 and/or 1221, 
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RAS lines 1212 and/or 1210, and WE lines 1210 and/or 1218 at the rising edge 
of CLK 1208 and/or CLK 1216. 

At step 1520 and from time t9 to time tl4, control logic may cause the 
write data to be provided to the selected SDRAMs on data lines 1224, 1225, 
1226, and/or 1227 from data I/O circuitry 1022. For example, 32 bytes of data 
may be written to the four SDRAMs 1204-1207 in the following manner: 
from time t9 to time til data I/O circuitry 1022 may provide data packet DO 
including the first eight bytes, two bytes to each of the four SDRAMs; and 
from time til to time tl2 data packet Dl including the second eight bytes, two 
bytes to each of SDRAMs 1204-1207. DO and Dl may correspond to DATA1. 
Additionally, from time tl2 to time tl3 data I/O circuitry 1022 may provide 
data packet D2 including the third eight bytes, two bytes to each of SDRAMs 
1204-1207, and from time tl3 to time tl4 data packet D3 including the last 
eight bytes, two bytes to each of SDRAMs 1204-1207. D2 and D3 may 
correspond to DATA2. It will be appreciated that for other embodiments a 
different number of bytes and a different number of cycles may be required to 
write the selected the data to the selected SDRAMs. Although in this example 
all DRAMs are written to, in alternative embodiments a partial write to one 
(or less than all) of the SDRAMs may be executed. 

In an alternative embodiment, memory module controller 102 may 
also provide a bridge between system memory bus 1242 and SDRAMs 1204- 
1207 using a modified protocol. The modified protocol may be demultiplexed 
having a data bus and a separate control bus that transmits control 
information and address between a system memory controller (e.g., system 
memory controller 304 of Figure 3) and memory module controller 1202. 

In this embodiment, a read transaction from one or more of SDRAMs 
1204-1207 may be performed as shown in Figure 17 wherein row bus 1234 and 
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column bus 1236 are used as one control bus 1235 having eight signal lines. 
For other embodiments, a different number of signal lines may be used. 

From time tO to time tl, an activate command is sent on control bus 
1235 including a device, bank, and row address of selected memory locations 
5 in SDRAMs 1204-1207. In this embodiment, the activate command may be 
spread over two cycles (i.e., cycle 0 and cycle 1 in Table 1 below) of CLK 1228 in 
which data is transferred on each clock edge of the CLK 1228 (i.e., double- 
pumped). For one embodiment the packet format is as shown in Table 1 
where RQ[7:0] correspond to the signal lines of control bus 1235. 



10 



Cycle 


RQ[7] 


RQ[6] 


RQ[5] 


RQ[4] 


RQ[3] 


RQ[2] 


RQ[1] 


RQ[0] 


0 


ST 


SF 


D[4] 


D[3] 


D[2] 


D[l] 


D[0] 


B[0] 


0 


R[6] 


R[5] 


R[4] 


R[3] 


R[2] 


R[l] 


R[0] 


B[l] 


1 


R[13] 


R[12] 


R[ll] 


R[10] 


R[9] 


R[8] 


R[7] 


B[2] 



TABLE 1 



The activate command includes several fields: 

Bf2:01 Bank Select : Selects one of eight banks in SDRAMs 1204-1207; 
Dr4:01 Device Select : Selects one of 2 5 or 32 memory module 
15 controllers; 

R[13:0] R ow Address : Provides a row address for one or more locations 
selected in SDRAMs 1204-1207; and 

ST, SF Encoded Frame/Fast Command : Bits used to indicate whether a 
command is framed as indicated in Table 2. The Extended commands may 
20 include noop, precharge, refresh, and other commands. 
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ST 


SF 


Operation 


0 


0 


No Framing 


0 


1 


Frame an Active Command (page 
activate) 


1 


0 


Frame a Read/Write Command 
(page hit) 


1 


1 


Frame an Extended Command 



TABLE 2 



From time t2 to time t3, data request logic 1004 deserializes the 
command and address information and provides this information to control 
logic 1002. Control logic 1002 then provides the row address to the selected 
5 SDRAMs over address bus 1214 and/or 1222, and the appropriate bank 

activate command to the selected SDRAMs over control bus 1238 and/or 1240 
(e.g., as described above with respect to Figures 13 and 14). 

From time t4 to time t5, a read command is sent on control bus 1235. 
The read command includes device, bank, and column address information 
10 for the desired read locations in the SDRAMs. In this embodiment, the read 
command may be spread over two cycles (i.e., cycle 0 and cycle 1 in Table 3 
below) of CLK 1228, and have a packet format as shown in Table 3. 



Cycle 


RQ[7] 


RQ[6] 


RQ[5] 


RQ[4] 


RQ[3] 


RQ[2] 


RQ[1] 


RQ[0] 


0 


ST 


SF 


D[4] 


D[3] 


D[2] 


D[l] 


D[0] 


B[0] 


0 


Q6] 


C[5] 


C[4] 


C[3] 


C[2] 


C[l] 


C[0] 


Ql] 


1 


AP 


R/W 


C[ll] 


C[10] 


C[9] 


C[8] 


C[7] 


C[2] 



TABLE 3 
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The read command includes several different fields not present in the 
activate command: 

C[ll:01 R ow Address : Provides a column address for one or more 
locations selected in SDRAMs 1204-1207; 
5 R/W Read Write : indicates whether the command is a read 

transaction or a write transaction. When this signal is in one logical state it 
indicates a read transaction, and when it is in the complementary logic state it 
indicates a write transaction; and 

AP Autop recharge : Indicates whether the selected column (or row) of 
10 selected memory cells should be precharged after reading. 

From time t6 to time t8, request handling logic 1004 deserializes the 
read command and provides this information to control logic 1002. Control 
logic 1002 then provides the column address and the read command to the 
selected SDRAMs over address bus 1214 and/or 1222 and over control bus 
15 1238 and/ or 1240, respectively, (e.g., as described above with respect to Figures 
13 and 14). If the first read command READ1 on control bus 1235 addresses 
less bytes of data and the read command issued to SDRAMs 1204-1207, then a 
second read command READ2 may be issued from time t7 to time t9. 

From time tlO to time tl6, data I/O circuitry 1022 may receive data read 
20 from the selected SDRAMs. For example, 32 bytes of data may be read from 
the four SDRAMs 1204-1207 in the following manner: from time tlO to time 
til data I/O circuitry 1022 may receive data packet DO that includes the first 
eight bytes, two bytes from each of the four SDRAMs 1204-1207; from time til 
to time tl2 data packet Dl that includes the second eight bytes two bytes from 
25 each of the four SDRAMs; from time tl3 to time tl4 data packet D2 that 

includes the third eight bytes, two bytes from each of the four SDRAMs; and, 
from time tl4 to time tl6 data packet D3 that includes the last eight bytes, two 
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bytes from each of the four SDRAMs. It will be appreciated that for other 
embodiments a different number of bytes and a different number of cycles 
may be required to read the selected data from the selected SDRAMs. 

When the read data is received, it may be stored in read buffer 1038 
5 prior to providing the data to data handling logic 1046. Alternatively, it may 
be provided directly to data handling logic 1046. At step 1314, data handling 
logic may serialize or pack the data into the proper format expected by the 
system memory controller on data bus 1232. For one embodiment, data 
packets DO and Dl, including a total of 16 bytes of data from SDRAMs 1204- 

10 1207, may be packed into one uninterrupted transmission DATA1 that may 
provided to data bus 1232 from time tl2 to time tl5. Similarly, data packets D2 
and D3, including a second 16 bytes of data from SDRAMs 1204-1207 may be 
packed into one uninterrupted transmission DATA2 that may provided to 
data bus 1232 from time tl5 to time tl7. 

15 For this embodiment, a write transaction to one or more of SDRAMs 

1204-1207 may be performed as shown in Figure 18. From time tO to time tl, 
an activate command as shown in Table 1 is sent on control bus 1235 
including a device, bank, and row address of memory locations in one or 
more of SDRAMs 1204-1207. Data request logic 1004 deserializes the 

20 command and address information and provides this information to control 
logic 1002. 

From time t2 to time t3, a write command is sent on control bus 1235 
that includes device, bank, and column address information for the desired 
write locations in SDRAMs 1204-1207. The write command uses the packet 
25 format shown in Table 3 with the R/W bit set appropriately to indicate a write 
transaction. Request handling logic 1004 deserializes the write command and 
provides this information to control logic 1002. If there is a difference 
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between the number of bytes selected for writing in SDRAMs 1204-1207(e.g., 
32 bytes) and the number of bytes selected by the single write transaction 
issued by the system memory controller (e.g., 16 bytes), then the first write 
command WRITE1 on control bus 1235 may write a first amount (e.g., 16 
5 bytes) of data, and a second write command WRITE2 may be issued from time 
t4 to time t5 to write a second amount of data (e.g., another 16 bytes). 

From time t6 to time t9, data handling logic 1046 may receive write data 
DATA1 from data bus 1232 and may unpack or deserialize the write data. 
Data handling logic 1046 may store the write data DATA1 into write buffer 

10 1012, and address storage 1014 may store the write address output by request 
handling logic 1004. If a subsequent write or read command is received, 
control logic 1002 may inspect write buffer 1012 and address storage 1014 for 
the requested address. If the address is located in address storage 1014, then 
the corresponding data in write buffer 1012 may be read or overwritten. If a 

15 subsequent write command WRITE2 is issued, then DATA2 received from 
time t9 to time til, and associated with this command, may be unpacked or 
deserialized and also stored in write buffer 1012. 

From time t7 to time t8, control logic 1002 then provides the row 
address to the selected SDRAMs over address bus 1214 and/or 1222, and the 

20 appropriate bank activate command to SDRAMs 1204-1207 over control bus 
1238 and/or 1240 (e.g., as described above with respect to Figures 15 and 16). 
From time til to time tl2, control logic 1002 then provides the column 
address and the write command to the selected SDRAMs over address bus 
1214 and/or 1222 and over control bus 1238 and/or 1240, respectively (e.g., as 

25 described above with respect to Figures 15 and 16). 

From time tlO to time tl5, control logic may cause the write data to be 
provided to the selected SDRAMs on data lines 1224, 1225, 1226, and/or 1227 
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from data 1/ O circuitry 1022. For example, 32 bytes of data may be written to 
the four SDRAMs 1204-1207 in the following manner: from time tlO to time 
tl2 data I/O circuitry 1022 may provide data packet DO including the first eight 
bytes, two bytes to each of the four SDRAMs; and from time tl2 to time tl3 
5 data packet Dl including the second eight bytes, two bytes to each of SDRAMs 
1204-1207. DO and Dl may correspond to DATA1. Additionally, from time tl3 
to time tl4 data 1/ O circuitry 1022 may provide data packet D2 including the 
third eight bytes, two bytes to each of SDRAMs 1204-1207, and from time tl4 to 
time tl5 data packet D3 including the last eight bytes, two bytes to each of 

10 SDRAMs 1204-1207. D2 and D3 may correspond to DATA2. It will be 

appreciated that for other embodiments a different number of bytes and a 
different number of cycles may be required to write the selected the data to the 
selected SDRAMs. Although in this example all DRAMs are written to, in 
alternative embodiments a partial write to one (or less than all) of the 

15 SDRAMs may be executed. 

Although the present invention has been described in terms of specific 
embodiments, it will be appreciated that various modifications and 
alterations might be made by those skilled in the art without departing from 
the spirit and scope of the invention. The invention should therefore be 

20 measured in terms of the claims which follow. 
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I 

CLAIMS 

What is claimed is: 

11. A system comprising: 

2 a system memory controller; and 

3 a first memory module comprising: 

4 a first memory module controller coupled to the system 

5 memory controller; and 

6 a first plurality of memory devices coupled to the first memory 

7 module controller. 

1 2. The system of claim 1, further comprising a first memory bus coupled 

2 between the system first memory module and the first memory module 

3 controller. 

1 3. The system of claim 2, wherein the first memory bus comprises a clock 

2 signal. 

1 4. The system of claim 2, wherein the first memory bus comprises a 

2 handshake signal that indicates when the first memory module controller is 

3 communicating data to the system memory controller. 

1 5. The system of claim 2, further comprising a second memory bus 

2 coupled between first memory module controller and the first plurality of 

3 memory devices. 

1 6. The system of claim 5, wherein the second memory bus comprises a 

2 clock signal. 



-42- 



42390.P5346 



1 

2 
3 



7. The system of claim 5, wherein the first memory bus operates at a first 
data rate and the second memory bus operates at a second data rate, wherein 
the first data rate is different than the second data rate. 



1 8. The system of claim 5, wherein the first memory bus has a first number 

2 of signal lines and the second memory bus has a second number of signal 

3 lines, wherein the first number of signal lines is different than the second 

4 number of signal lines. 

1 9. The system of claim 5, wherein the first memory module controller 

2 comprises: 

3 request handling circuitry structured to receive a first memory 

4 transaction from the first memory bus; and 

5 control logic coupled to the request handling circuitry and generating a 

6 second memory transaction on the second memory bus corresponding to the 

7 first memory transaction on the first bus. 

1 10. The system of claim 2, wherein the first memory bus carries time- 

2 multiplexed data and address information, and the second memory bus 

3 includes separate address and data lines. 

1 11. The system of claim 1, wherein the first memory module is a dual in- 

2 line first memory module (DIMM). 

1 12. The system of claim 1, wherein the first memory module is a single iri- 

2 line first memory module (SIMM). 

1 13. The system of claim 1, wherein the first plurality of memory devices 

2 comprise volatile memory devices. 
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1 14. The system of claim 1, wherein the first plurality of memory devices 

2 comprise nonvolatile memory devices. 

1 15. The system of claim 1, further comprising a second memory module 

2 comprising: 

3 a second memory module controller coupled to the system 

4 memory controller; and 

5 a second plurality of memory devices coupled to the second 

6 memory module controller. 

1 16. The system of claim 15, wherein the first plurality of memory devices 

2 stores data in a different way than the second plurality of memory devices. 

1 17. A system comprising: 

2 a system memory controller; 

3 a memory bus coupled to the system memory controller; and 

4 a memory comprising: 

5 a memory module controller coupled to the memory bus; and 

6 a plurality of memory devices coupled to the memory module 

7 controller, wherein the memory module controller receives a first memory 

8 transaction from the memory bus in a first format and provides a second 

9 memory transaction in a second format to at least one of the second plurality 
10 of memory devices. 



1 18. A method of communicating a memory transaction between a system 

2 memory controller and at least one of a plurality of memory devices on a 

3 memory module including a memory module controller, the method 

4 comprising the steps of: 

-44- 42390.P5346 



5 sending a memory transaction from the system memory controller to 

6 the memory module controller, the memory transaction having a first 

7 format; 

8 reformatting the memory transaction for the at least one of the 

9 memory devices; and 

10 sending the reformatted memory transaction to the at least one of the 

11 memory devices. 

1 19. The method of claim 18, wherein the memory transaction is a read 

2 transaction. 

1 20. The method of claim 18, wherein the memory transaction is a write 

2 transaction. 

3 
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ABSTRACT 

A system that has a system memory controller and a memory module. 
The memory module includes a memory module controller coupled to the 
system memory controller and a plurality of memory devices coupled to the 
memory module controller.. 
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ZAFMAN LLP, 12400 Wilshire Boulevard, 7th Floor, Los Angeles, California 90025 and 
direct telephone calls to Roland B. Cortes (408) 720-8598. 

(Name of Attorney or Agent) 

I hereby declare that all statements made herein of my own knowledge are true and that all 
statements made on information and belief are believed to be true; and further that these 
statements were made with the knowledge that willful false statements and the like so made 
are punishable by fine or imprisonment, or both, under Section 1001 of Title 18 of the 
United States Code and that such willful false statements may jeopardize the validity of the 
application or any patent issued thereon. 
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Full Name of Sole/First Inventor Thomas J. Holman 

Inventor's Signature Date 

Residence Portland. OR Citizenship UJL 

(City, State) (Country) 

Post Office Address 3045 N.W. Baven Woods Drive 

Portland. OR 97229 . 
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Title 37, Code of Federal Regulations, Section 1 .56 
Duty to Disclose Information Material to Patentability 



(a) A patent by its very nature is affected with a public interest. The public interest is best served, 
and the most effective patent examination occurs when, at the time an application is being examined, the 
Office is aware of and evaluates the teachings of all information material to patentability. Each individual 
associated with the filing and prosecution of a patent application has a duty of candor and good faith in dealing 
with the Office, which includes a duty to disclose to the Office all information known to that individual to be 
material to patentability as defined in this section. The duty to disclosure information exists with respect to 
each pending claim until the claim is cancelled or withdrawn from consideration, or the application becomes 
abandoned. Information material to the patentability of a claim that is cancelled or withdrawn from 
consideration need not be submitted if the information is not material to the patentability of any claim remaining 
under consideration in the application. There is no duty to submit information which is not material to the 
patentability of any existing claim. The duty to disclosure all information known to be material to patentability 
is deemed to be satisfied if all information known to be material to patentability of any claim issued in a patent 
was cited by the Office or submitted to the Office in the manner prescribed by §§1 .97(b)-(d) and 1 .98. 
However, no patent will be granted on an application in connection with which fraud on the Office was practiced 
or attempted or the duty of disclosure was violated through bad faith or intentional misconduct. The Office 
encourages applicants to carefully examine: 

(1 ) Prior art cited in search reports of a foreign patent office in a counterpart application, and 

(2) The closest information over which individuals associated with the filing or prosecution of a 
patent application believe any pending claim patentably defines, to make sure that any material information 
contained therein is disclosed to the Office. 

(b) Under this section, information is material to patentability when it is not cumulative to 
information already of record or being made or record in the application, and 

(1 ) It establishes, by itself or in combination with other information, a prima facie case of 
unpatentability of a claim; or 

(2) It refutes, or is inconsistent with, a position the applicant takes in: 

(i) Opposing an argument of unpatentability relied on by the Office, or 

(ii) Asserting an argument of patentability. 

A prima facie case of unpatentability is established when the information compels a conclusion that a claim is 
unpatentable under the preponderance of evidence, burden-of-proof standard, giving each term in the claim its 
broadest reasonable construction consistent with the specification, and before any consideration is given to 
evidence which may be submitted in an attempt to establish a contrary conclusion of patentability. 

(c) Individuals associated with the filing or prosecution of a patent application within the 
meaning of this section are: 

(1 ) Each inventor named in the application; 

(2) Each attorney or agent who prepares or prosecutes the application; and 

(3) Every other person who is substantively involved in the preparation or prosecution of the 
application and who is associated with the inventor, with the assignee or with anyone to whom there is an 
obligation to assign the application. 

(d) Individuals other than the attorney, agent or inventor may comply with this section by 
disclosing information to the attorney, agent, or inventor. 
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